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Introduction 


Let  {X^}  and  {B^},  i  -  0,1,2,...,  be  sequences  of  nonnegative 
random  variables  and  define  the  sequence  {d^}  by 

Dn+i  =  niax  (o,D^  +  -  B^),  n=0,l,2 -  (1) 

Equation  (1)  will  be  familiar  to  any  reader  who  has  studied  the 
single  channel  queue  with  FIFO  order  of  service.  If  X^  is  the 

service  time  of  customer  n  and  B  is  the  time  between  arrivals 

n 

of  customers  n  and  n+1 ,  then,  if  customer  0  starts  a  busy 
period  (Dq  =  0) ,  represents  the  delay  in  queue  of  customer 

n  (see,  for  example,  Kleinrock  [1975],  p.  278) 

The  purpose  of  this  paper  is  to  analyze  the  distribution  of 
for  a  class  of  correlations  between  {X^}  and  {B^}.  In  section  1 

we  give  a  number  of  examples,  including  a  budgeting  problem,  which 

can  be  modelled  by  equation  (1)  with  such  correlations.  This 

budgeting  problem  is  used  to  illustrate  our  analyses.  In  section  2 

we  analyze  the  case  B  =  X  ^ .  In  section  3  we  extend  our  results 

n  n-i 

to  the  case  where  B  is  a  convex  linear  combination  of  X  ,  through 

n  n- r 

X  „  for  some  £  ^  1.  In  section  4  we  interpret  our  result  for  the 
n-£ 

G/G/1  queue,  and  in  section  5  we  suggest  areas  for  future  study. 

1 .  Examples 

Consider  a  budgeting  process  in  discrete  time,  where  demands 
for  funds  occur  over  time,  and  unused  funds  budgeted  in  a  given 
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period  cannot  be  carried  forward,  but  where  unfilled  demands  are 
carried  forward.  Examples  of  such  budget  processes  occur  in 
government  agencies  operating  from  one  fiscal  year  to  the  next. 

If  is  the  demand  for  funds  in  period  n,  and  the  budget 

allocated  to  period  n,  then  is  the  budget  deficit  at  the 

start  of  period  n+1.  For  an  example  in  the  U.  S.  Navy  supply 
system,  see  Daeschner  [1975].  The  budgeting  problem  is  the  example 
that  we  pursue  in  this  paper.  However,  the  following  examples  also 
fit  the  same  structure  of  equation  (1) .  It  is  left  to  the  reader 
to  interpret  our  results  for  these  examples. 

Consider  a  job  shop  which  is  scheduled  in  discrete  time 
periods.  Let  be  the  demand  in  period  n  for  some  resource 

such  as  manhours.  Such  a  resource,  if  not  used  in  the  given  period, 
is  lost.  Let  be  the  amount  of  resource  allocated  by  a  planning 

process  for  period  n.  Although  unused  resources  like  manhours 
cannot  be  carried  forward  from  period  to  period,  unfilled  demands 
for  these  resources  must  eventually  be  satisfied.  Thus,  repre¬ 

sents  the  work  backlog  at  the  start  of  period  n. 

Consider  now  a  reservoir  control  problem.  Let  the  water 
output  in  period  n  be  B^  and  assume  that  the  input  to  the 

reservoir  in  period  n  is  X^ .  Let  be  the  reservoir  content 

at  the  start  of  period  n.  Then  the  sequence  |  D^j  satisfies 

equation  (1)  (assuming  infinite  reservoir  capacity) . 


2 


Consider  next  a  periodic-review  inventory  process  with  a  single 

perishable  item.  Let  X  be  the  demand  in  period  n  and  B  the 
^  n  n 

stock  which  arrives  in  period  n.  Let  D  be  the  amount  on  back- 

n 

order  at  the  start  of  period  n.  Again  the  sequence  | 
satisfies  (1) . 

Finally,  equation  (1)  can  be  given  the  following  queueing 
interpretation.  Consider  a  service  system  which  is  reviewed 
periodically.  Let  be  the  total  number  of  arrivals  in  period 

n  and  the  total  service  capacity  in  period  n.  Then 

represents  the  "queue"  at  the  start  of  period  n+1. 

Unlike  the  simple  GI/G/1  queue  discussed  in  the  intro¬ 
duction,  in  the  above  examples  it  may  not  be  realistic  to  assume 
that  the  two  sequences  |x^[  and  jB^j  are  independent  or  that 

each  is  a  sequence  of  iid  random  variables.  In  the  following 
sections  we  investigate  the  behavior  of  for  a  number  of 

cases  where  the  two  sequences  are  correlated. 

We  end  this  section  with  a  well  known  result  (see,  for 
example,  Kleinrock  [1975],  p.  278),  that  if  ~  ^n  ~  ^n ' 

then 

°n+l  =  Max(0,U^,U^  +  U^_^,...,U^  +  +  ...  +  +  uj  (2) 

Equation  (2)  which  is  equivalent  to  equation  (1)  will  be  important 
in  our  analyses. 
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2. 


Single  Period  Correlation 


In  this  and  later  sections  we  focus  on  the  budgeting 
example  discussed  earlier.  Let  the  sequence  of  demands  {x^} 

be  iid  random  variables  with  finite  first  moment  y  and 
distribution  function  F,  and  let  the  budget  allocated  to 
period  n  be  equal  to  the  demand  in  period  n-1.  Thus, 

T  ,  n  >  1.  (3) 

n  n-i 


Let  be  an  independent  random  variable  distributed  as 
X^ .  From  (3)  and  the  definition  of  we  have. 


U  +  U  ,  +  ...+U  .=  X  -X 

n  n-1  n-i  n  n-i-1 


i  =  0,1, .. . ,n-l  (4) 


and 


U  !-  U  T  +  .  .  .  +  U,v  =  X  - 
n  n-1  0  n  0 


Thus,  from  (2) 

D  ^,  =  Max  f0,X  -  X  wX  -  X  _,  ...,X  -  Xr>,X„-B^\ 

n+l  \  '  n  n-1  n  n-2'  n  0'  n  0/ 

which  can  be  rewritten  as 

D  =  Max  (  0,  X  -  Min  (X  ^  ,X  „  ,  .  .  .  ,X^,Bf^)').  (5) 

n+l  \  n  n-1  n-2  0  0  / 


Now,  let  m  =  inf {x | F (x) >0 } .  Clearly,  m  is  the  minimum  demand 
that  could  occur  in  any  period.  If  we  let 


Y  =  Min 
n 


^n-l'^n-2' 
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then 


“n+1 

=  Max(0,X  -  Y  ) 
n  n 

and 

(6) 

P[Vn 

>  y]  =  [l-F(y)]''  = 

[F(y) 

(7) 

where  F (y) 

=  1  -  F(y)  . 

By  using  conditional  probability  arguments,  we  determine  the 
distribution  of  from  (6)  and  (7)  to  be 


]  =  Fix~)+J  j^F  ((u-x)"j 


n 


dF(u)  , 


X  ^  0.  (8) 


From  the  definition  of  m. 


F(x)^  ->  1  for  X  <  m  and  F(x)’^  0  for  x  >  m. 

Thus  we  see  that  ^  |  converges  in  distribution  to  a  random  variable, 

say  D,  with  distribution  function  D(x),  where 

D(x)  =  F  (m  +  x)  ,  X  >  0. 

From  (8)  it  is  straight  forward  to  show  that 


E  (D 


n+1 


=  y 


n+1 


du 


and  therefore, 

E (D)  =  y  -  m.  (9) 

The  above  equations  show  that  the  budgeting  process  can  be 
operated  without  planned  surplus  resources,  i.e.  ~ 
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and  deficits  remain  small  and  well  behaved.  In  the  language 
of  queues,  (9)  would  indicate  that  the  single  channel  queue 
can  be  operated  with  traffic  intensity 


E[B  ] 

P  =  - —  =  1 

EIXp) 

and  with  finite  (indeed  small!)  waiting  times.  This  result  needs 
closer  scrutiny,  and  we  return  to  it  in  section  4. 

Let  i  be  the  index  of  a  period  with  =  0  and  let 

K(>i)  be  the  first  succeeding  period  with  zero  deficit.  Now 
let  N  =  K  -  i+1.  -In  queueing  theory,  N  is  analogous  to  the 
number  of  customers  served  in  a  busy  period.  Now 

{N>n}  <=>{Uj^>0,  +  U2>0,  .  .  .  ,0^^  +  +  ...  +  >  0}  .  (10) 


Using  (3)  and  (4) ,  (10)  can  be  shown  to  be 


{N>n}  <=>  {X^>X^,X2>X^, . . . ,X^>X^} . 


Since  the  demands  {X  }  are  assumed  to  be  iid, 

n 


P(N>n)  =  /  F  (u)’^dF(u)  =  / 

0 


n  =  0,1,2, . . .  (11) 


independent  of  the  demand  distribution  F.  Thus,  although  the 
"busy  periods"  are  finite  with  probability  1,  they  have  an  infinite 
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is  the  surplus 


mean.  This  would  lead  us  to  believe  that  if  S 

resource  at  the  end  of  period  n  (which  is  lost  at  the  beginning 

of  period  n  +  1),  then,  for  large  n,  S  would  be  zero  with 

n 

probability  1.  We  now  show  this  to  be  the  case.  First,  note 
that 

S  =  Max  (o^B  -  (D  +  X  ))  . 
n  '  n  n  n  / 


Combining  this  equation  with  (1)  yields 


D 


n+1 


S  =  D  +  X  -  B 
n  n  n  n 


where  ^n+l^n  ~  Taking  expected  values  in  this  equation 

gives 

E[S^]  =  0. 

Here  we  have  assumed  n  large  so  that  E[D  .,]  =  E[D  ].  Since 

n+1  n 

is  a  non-negative  random  variable,  it  must  be  zero  with 
probability  1. 


3 .  Multiperiod  Correlation. 

In  this  section  we  extend  the  results  in  section  2  by 
letting  the  budget  in  period  n  be  a  function  of  the  demands  in 
periods  n-1,  n-2 ,  .  .  .  ,  (n-S.)  for  some  fixed  integer  1.  Specifi¬ 
cally,  let  a^  ^  0  and  ~  If 

I 

B  =  y  a.X  .,  n=0,l,2,...  (12) 

n  . ^ ,  1  n-i  ’  ' 

1=1 
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For  n  <  J-/  we  require  the  introduction  of  the  additional  random 
variables  that  will  be  well-defined. 

As  with  lx.!  .  we  assume  that  !  X  ,  ,  X  X  .  !  is 

I  1)  1=0  1-1  -2  -I  \ 

a  set  of  iid  random  variables  with  distribution  function  F. 
Note  that  ja^l'^a^  =  l,a^  ^  g[  contains  the  3  special  cases  : 

a)  a^^  =  1,  a^  =  0  for  i  <  , 


b)  a^  =  1/1  i  Z  , 

(1-a) 

c)  a .  =  — -  ,  0<c<<l,  i^£. 

^  ,1  Z) 

(1  -  a 

Case  b)  gives  the  arithmetic  average  and  case  c)  gives 
as  a  truncated  exponentially  weighted  average  of  the  past 

demands  (see,  for  example,  Brown  [1959]).  The  model  in  section 
2  is  the  case  a)  with  2,  =  1 .  In  all  cases  given  by  (12),  B^ 

is  an  unbiased  estimate  of  y ,  the  expected  demand  in  a  period. 


A  )cey  to  our  analysis  in  this  section  is  the  following 
Lemma:  For  fixed  £  >  1,  let  the  budget  B^  be  given  by  (12) , 


and  let  A. 

1 


Z 

I 


3=1 


a . . 
3 


If  we  define 


V 

n 


i=l 


A-X  .  , 
1  n-i+1 


n  =  -1,0,1,...,  (13) 
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Therefore 


X 


V 


n 


M  >  X 
n 


>  P 


V 


n 


M. 


k(n) 


>  X 


But  and  independent  and 

'“k(n)  > 

Thus 


“n+l  "  =< 


->  /[-( 
*'x 


dV(n) 


(16) 


Combining  (15)  and  (16)  gives 


V(x)  -  f  V(u-x)^^^^ 

dV(u) 

s  F 

D  >  X 

n+1 

^  v|x  +  m(A,2)j  .  (17) 

J 

X 

As  n  ^  00/  V(u)^^^^  1 

for 

0  ^ 

u  ^  m  (A,  2) 

^  0 

for 

m  (A, 

,2)  <  a. 

Thus 


/ 


(u-x)^^’^^dV(u) 


V  ^x  +  m  (A,  2.  )j  - 


V(x)  =  V(x)  -  V  X  +  m(A,2) 


X 


When  this  result  is  used  in  (17) ,  we  have  that 


By  integration  over  x  in  (17) ,  it  is  straight  forward 


to  show  that 


V 


-  J  V(u)^  ^  ^  j  V(u)du, 


(18) 


m(A,£  ) 


where  v 


=  ^K]  =  \  • 

1-1 


Taking  the  limit  in  (18) ,  we  see  that 


n+1 


(y  -  m)  E  A.  . 

i=l  ^ 


(19) 


Notice  that,  as  in  section  2,  the  deficits  remain  bounded  without 
planned  surplus  resources  |i.e.,  E  j  =  E  j  • 


Now  we  look  at  the  random  variable  N,  and  note  that  (10) 
still  holds.  Using  the  result  in  the  proof  of  the  lemma  that 


U  =  V  -  V  T  , 
n  n  n-1' 


In  >  n}  <=>  |v^  >  v„,  Vj  >  . 


Now 


>  Vg.Vj  >  Vp . >  Vo)  =>,lVj  >  Vp.Vjj  >  V„ . >Voj, 


where  again  k(n)  =  [  ^ j '  n  <  2.  the  event  on  the  right 

hand  side  is  taken  to  be  the  certain  event.  Then  it  is  easy  to 
show  that 

N  >  n 


k(n)+l 
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r 

Of  course  this  does  not  show  that  ^  J 
to  be  the  surplus  resource  at  the  end 


the  same  method  as  in  section 


"busy  periods"  never  end  with  probability 
in  fact  infinite. 


is 

of 

0 

1 


finite.  By  defining 
period  n,  and  using 


for  large  n.  Thus 
and  hence  eTn 


IS 


We  now  look  at  some  specific  examples  of  the  budget  policy 
given  in  (12).  First,  let  a^  =  0  for  i  =  1,  2,...,  2,-1,  and 

=1.  Thus,  B  =  X  which  sets  the  budget  in  period  n 

equal  to  the  demand  in  period  n  -  2- .  Then  =  1  for 

I 

i  =  1,  2,  ...,2  and  A.  =  2.  Then  D(x)  =  F  (x  +  m2),  and 

i=l  ^ 


E^dJ  =  (M  -  m)  .  Thus,  if  we  considered  a  sequence  of  policies 
with  parameter  2,  we  see  that  the  equilibrium  deficits  stochastically 
increase  linearly  with  2,.  We  conclude  that  if  such  a  budget 
policy  is  to  be  used,  it  is  best  to  use  the  demand  for  the  most 
recent  period  for  which  information  is  available.  Notice  that  if 
the  demand  is  not  deterministic,  then  y  -  m  >  0  .  One  can  think 
of  the  budgets  and  demands  being  less  dependent  as  2  increases. 

Note  that  as  2  our  result  is  consistent  with  that  of  the 


GI/G/1  queue  with  P  =  1,  namely  that  E 
large. 


D 


become  infinitely 


Suppose  that  we  interpret  equation  (12)  to  be  an  attempt 
to  forecast  the  demand  in  period  n  from  data  on  past  demands. 
Having  obtained  a  forecast,  one  would  then  allocate  matching  re¬ 
sources.  The  best  (or  BLUE)  estimator  of  the  expected  demand 
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is  obtained  by  setting  =  l/£,  i  ^  in  equation  (12)  and 

using  large  (recall  our  demands  are  stationary)  .  But  if  the 
objective  is  to  minimize  deficits,  we  see  from  (19)  that  the 
optimal  weights  in  (12)  are  a^=l,  a^=0,  i>  1.  These 
weights  minimize  both  the  expected  deficit  and  the  variance  of 
the  deficit.  In  fact,  the  reader  can  verify  that  the  deficit 
with  Jl  =  1  is  stochastically  smaller  than  any  other  case  which 
satisfies  (12) . 

4 .  Interpretation  in  the  Standard  Queueing  Model 

The  budget  policies  defined  by  (12)  are  physically 

realizeable  when  n  in  (12)  indexes  discrete  time  periods.  In 

such  cases,  it  is  possible  to  know  X  .  for  some  positive  £ 

ri  “  X/ 

in  time  to  set  the  budget  for  period  n.  In  the  case  of  the 
single  channel  queue  where  n  indexes  the  customers  in  order  of 
arrival  and  service,  a  policy  of  would  imply  that 

arrivals  could  be  scheduled,  and  that  the  interarrival  time 
between  customers  n  and  n  +  1,  B^,  should  be  set  equal  to 

the  service  time  of  customer  n-£,  namely  with  £  =  1 

leading  to  the  shortest  delays  in  queue. 

For  simplicity,  let  m  =  0.  Then  from  (14)  ^^4-1  “ 

with  probability  1  in  steady  state.  Now, if  B^  =  then 

D,,  =  X  +  X  ,  +  ...+X  rt,,.  The  situation  is  drawn  in 

n+1  n  n-1  n-£+l 

fijure  1  for  £  =  3  and  the  queue  in  steady  state.  Note  that 
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and  occur  simultaneously.  Clearly,  such  a  situation 

cannot  be  realized  unless  the  service  time  X  _  is  known  by 

the  time  customer  n-3  starts  service.  When  this  is  the  case, 
customer  n+1  is  scheduled  to  arrive  at  the  completion  of  service 
of  n-3.  Thus,  there  are  always  exactly  3  customers  in  the 
system. 


(n) 


(n+1) 


(n+2) 


Arrivals 


B 


n 


B 


n+1 


B 


n+2 


(n+3)  (n+4) 

B 


n+3 


D 


n 


Figure  1 :  Steady  State  Realization  with 
&  =  3,  a^  =  1,  m  =  0 . 


5 ,  Conclusions  and  Suggestions  for  Future  Work. 

In  this  paper  we  have  identified  applications  of  the 
"waiting  time"  random  variable  outside  the  standard  applications 
in  queueing  theory  and  have  illustrated  them  by  examples  in 
budgeting.  To  make  the  applications  realistic,  we  allowed  the 
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"service  times"  and  "inter-arrival  times"  to  be  correlated.  For 
a  simple  class  of  correlation  relationships  we  determined  the 
distribution  (or  bounds  on  the  distribution)  for  the  "waiting 
times"  and  for  the  "busy  period"  and  we  showed  that  the  process 
with  traffic  intensity  of  unity  (no  excess  budget)  can  operate 
1)  with  small  waiting  "times"  (deficits) ,  2)  without  planned 
"idle  times"  (surplus  funds) ,  and  3)  with  infinitely  long  expected 
"busy  periods."  We  also  show,  where  is  an  unbiased  linear 

estimate  of  y,  that  it  is  optimal  to  select  a^^  =  1,  i.e., 

B  =  X  , ,  in  order  to  minimize  both  the  expected  value  and 
the  variance  of  the  "waiting  times." 

Because  of  the  plethora  of  results  for  the  single-channel 
queue  with  independent  service  and  interarrival  times,  our  results 
may  surprise  many  of  our  readers.  Certainly,  most  were  initially 
non-intuitive  to  the  authors.  We  see  from  these  results  some  of 
the  consequences  of  the  assumption  of  independence  of  the  sequences 
iB  !  and  Ix  j  .  In  particular,  we  see  that  some  forms  of  correlatior 
between  the  two  sequences  enable  one  to  schedule  resource  utiliza¬ 
tion  very  efficiently. 

One  can  postulate  more  complex  interrelations  both 
between  and  within  the  sequences  j |  and  j bJ.  For  example, 
demands  may  not  be  iid  random  variables.  They  may  be  independ¬ 
ent  but  growing,  or  they  may  be  serially  correlated.  There  is 
much  evidence  (see  ,  for  example,  Capra  [l974j  and  Gaver  |1975  ) 
that  in  governmental  budgeting  the  appropriation  of  funds  depends 
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on  previous  appropriations  as  well  as  demands  and  deficits. 


Although  some  statistical  work  has  been  carried  out 
"within-sequence"  correlations,  the  authors  believe 
is  much  work  to  be  done  in  analyzing  the  effects  of 
lated  budgeting  policies  on  deficits  and  surpluses. 


to  demonstrate 
that  there 
such  corre- 
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